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Abstract 

We  consider  general  nonlinear  dynamical  systems  in  a  Banach  space  with  depen¬ 
dence  on  parameters  in  a  second  Banach  space.  An  abstract  theoretical  framework 
for  sensitivity  equations  is  developed.  An  application  to  measure  dependent  delay 
differential  systems  arising  in  a  class  of  HIV  models  is  presented. 
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1  Introduction 


The  qualitative  and  quantitative  investigation  of  parameter  dependent  systems  is  ubiquitous 
in  science  and  engineering.  The  wide  spread  desire  to  treat  uncertainty  leads  to  the  need 
to  treat  distributions  of  parameters  in  diverse  applications  ranging  from  classical  physio¬ 
logically  based  pharmacokinetics  (PBPK)  models  [6],  [21],  [36]  to  social  networks  (e.g.,  the 
diffusion  of  ideas  in  populations  [16])  to  random  effects  and  mixing  distributions  in  statistical 
modeling  [22],  [28],  [29],  [30].  A  powerful  tool  for  the  investigation  of  parameter  dependency 
is  the  sensitivity  matrix.  Equations  for  the  sensitivity  of  a  system  with  respect  to  vector  pa¬ 
rameters  are  used  in  optimization  and  inverse  problems  (least  squares,  maximum  likelihood, 
standard  errors  in  statistics- [23]),  model  discrimination/model  selection  (dispersion  matrix, 
Fisher  information  matrix- [19]),  as  well  as  applications  in  biology  [17],  mechanics  [1],  [26], 
and  control  theory  [40].  The  large  literature  includes  a  number  of  books  devoted  to  both 
elementary  and  advanced  aspects  of  sensitivity  [20],  [24],  [25],  [26],  [34],  [40]. 

With  the  recently  growing  interest  in  incorporating  uncertainty  into  models  and  systems, 
the  need  to  employ  dynamics  with  probabilistic  structures  has  received  increased  empha¬ 
sis.  In  particular,  systems  with  probability  measures  embedded  in  the  dynamics  (problems 
involving  aggregate  dynamics  as  discussed  in  [6])  have  become  important  in  applications  in 
biology  [3],  [5],  [6],  electromagnetics  [7]  and  hysteretic  [10],  [11],  [18],  [27],  [31]  and  polymeric 
[12],  [13],  [14]  materials.  These  systems  have  the  form 

x(t)  =  P(t,x(t),P), 

where  P  is  a  probability  distribution  or  measure.  In  fact  such  systems  are  not  new  and  arise 
in  relaxed  or  chattering  control  problems  [32],  [33],  [35],  [37],  [38],  [39]  wherein  the  controls 
are  probability  measures.  Indeed,  such  systems  date  back  to  the  seminal  work  of  L.C.  Young 
on  generalized  curves  in  the  calculus  of  variations  [41],  [42], 

In  [3],  Banks  and  Bortz  consider  systems  which  depend  on  parameterized  probability 
measures  P  =  P(z/,  a2)  and  develop  a  framework  for  sensitivities  with  respect  to  the  mean 
v  and  variance  cr2  in  the  context  of  delay  differential  systems  for  HIV.  Here  we  present  a 
theory  treating  general  Banach  space  parameters  which  include  a  general  class  of  probability 
densities.  The  example  we  discuss  entails  a  non-parametric  density  version  of  the  HIV 
example  treated  in  [3]. 

Specifically,  we  study  the  sensitivity  equation  of  the  ordinary  differential  equation 

x(t)  =  f(t,x(t),n),  t>t0 

X(t0)  =  Xq,  (1) 

where  /  :  M+  xlx  JA  — >  X  and  X  and  A4  are  complex  Banach  spaces.  We  wish  to  show  for 
the  parameter  ju  in  a  Banach  space  A4,  the  Frechet  derivative  of  the  solution  x  with  respect 
to  /i,  -§^x(t,  to,  xo,  /a)  =  y(t),  exists  and  satisfies  the  equation 

i/(t)  =  fx(t,x(t,t0,x0,ti),fi)y(t)  + flt(t,x(t,t0,xQ,fi),ii),  t>t0 

y(to )  =  0.  (2) 
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Here  we  define  the  notation  that  is  used  throughout  this  paper.  Let  X  and  M.  be  two 
complex  Banach  spaces  and  for  x  G  X,  n  G  M.,  we  denote  by  \x\,  |  /i  | ,  the  norm  of  x  and  the 
norm  of  /i,  respectively.  The  space  of  bounded  linear  operators  from  A"  onto  Y  is  denoted  by 
B(X,Y).  We  let  C[A,B\  represent  the  class  of  continuous  functions  from  set  A  into  set  B. 
For  a  function  /  :  M+  x  X  x  JYI  — >  A",  the  Frechet  derivatives  with  respect  to  x  and  /i.  if  they 
exist,  are  represented  by  fx(t,x,p)  and  f^ft,  x,n)  and  belong  to  B(X,  X)  and  B(Xi,X), 
respectively. 


2  Theory 

Consider  the  abstract  differential  equation  (1)  where  /  :  M+  x  X  x  Xi  — »  X  is  a  continuous 
mapping;  it  is  clear  that  for  t  >  t0,  a  solution  x(t,  t0,  x0,  p)  of  (1)  satisfies  the  integral 
equation 

x(t,t0,x0,n)=x0+  f(s,x(s,t0lx0,n),ii)ds  t>t0.  (3) 

Jto 

In  order  to  study  the  sensitivity  of  solutions  of  (1),  we  first  need  to  show  the  solution  of 
(1)  exists  and  is  unique  (see  Lemma  1).  The  idea  of  the  proof  in  Lemma  1  follows  from 
the  standard  ODE  arguments  using  successive  approximations.  Therefore,  we  define  the 
successive  approximations  for  system  (1)  to  be  the  functions,  a;0,  a;1, ...,  given  recursively  by 


x°(t,t0,x0,n)  =  x0, 


xk+1(t,t0,x o,/i)  =  x0  +/  f(s,xk(s,t0,x0,ix),n)ds  t>t0, 


'to 


for  k  —  0, 1,  2, 


(4) 


Lemma  1 

and 


(Existence  and  Uniqueness  of  Solutions)  If  f  :  M+  x  X  x  Xi  — >  X  is  continuous 


f(t,x i,/i)  -  f(t,x a,//) 


<  C 


X\  -  x2 


(5) 


for  some  constant  C  >  0.  Then  the  successive  approximations  xk  converge  uniformly  for 
t  G  [to,T]  to  a  unique  solution  x  of  (1)  such  that  x(t0,  t0,  x0,  p)  =  Xq. 


Proof:  For  a  given  interval  /  =  [t0,  T]  where  t  G  /  and  a  fixed  p,  we  denote  M  >  0  such  that 
\f(t,xo,p)\  <  M  for  all  t  G  /.  Consequently,  we  have 


x1(t,t0,x0,n)  -  x0 


<  M  (t  —  t0). 


(6) 


In  order  to  establish  the  convergence  of  the  successive  approximations,  let  us  define 


Ak(t,t0,x0,p) 


xk+1(t,t0,x0,  p)  -  xk(t,t0,x 0,n) 
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Then, 


Ak(t,t0,x0,fi )  =  /  f(s,xk(s,t0,x0,ix),iJ,)  -  f(s,xk  1(s,t0,x0,n),n)ds 


<  /  \f(s,xk(s,t0,x0,fj,),fj,)  -  f(s,xk  1(s,t0,x0,fj,),(j,)  ds 


<  /  C  xk(s,t0,x0,n)  ~  xk  1(s,t0,x0,n)  ds, 


and  hence 


A  k(t,t0,x0,n)  <  C  Ak  1(s,t0,x0,/i)ds, 


where  C  >  0  is  the  Lipschitz  constant  of  (5). 
Now  we  claim 


Ak(t,t0,x0,fi)  < 


MCk(t  -  t0)k+1 
(k  +  1)! 


For  k  —  0,  we  have 


A°(t,t0,x0,n)  =  x*(t,  t0,  x0,  fi)  —  x0  <  M  (/  -  /,)) 


from  equation  (6).  Following  by  an  induction  on  (7),  we  have 

Ak+1(t,t0,x0,  n)  <  C  f  Ak(s,t0,x0,n)ds 


<  C  MC 


k{s~to)kT  ds 


(k  +  1)! 


<  MCk+1 


(t  -  h)k ^ 
(k  +  2)! 


Thus,  we  have  the  inequality  in  equation  (8)  holds  for  all  k  and  obviously  that  the  series 
SjfcLo  A fc(t,  t0,  x0,  n)  is  dominated  by  the  power  series  for  Me°^  t()) .  Hence,  by  the  comparison 
test  the  series  YlkLo  Afc(t,  ^o,  #o,  k)  is  uniformly  convergent  on  I.  It  follows  that  the  series 

OO 

x0  +  ^2(xk+1(t,  t0,  x0,  n)  -  xk(t,  t0,  x0,  h)) 

k= 0 

converges  uniformly  and  absolutely  on  I.  Consequently,  the  partial  sum 


xn{t,  t0,  xq,  /i)  =  x0  +  ^(a;fc+1(t,t o,x0,  fi)  -  xk(t,  t0,  x0,  n)) 
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Thus  Xi(t,  t0,  Xq,  h)  =  x2(t,  t0,  x0,  fi)  and  this  completes  the  proof. 

Lemma  2  (Continuous  Dependence  of  Solutions  on  Parameters)  Let  f  €  (7[M+  xX  x  M.,  X] 
and  for  fi  =  /io,  let  x(t,  to,  xq,  no)  be  a  solution  of 

x  =  f(t,x,fjn o),  x(t0)=x0,  (10) 

existing  on  [to,T].  Assume  further  that 

lim  fit,  x,  n)  =  f(t,  x,  Ho),  (11) 

M— 

uniformly  in  (t,  x)  and  for  (t,  x\,  /a),  (t,  x2,  ff)  G  M+  x  X  x  M., 

f(t,Xi,fi)  -  f{t,X2,n)  <C  x  !-x2  (12) 

for  some  constant  C  >  0.  Then  the  differential  system 

x  =  f{t,x,n),  x(t0)=x0,  (13) 

has  a  unique  solution  x(t,  to,  xq,  jf)  satisfying 

lim  x(t,to,x0,ii)  =  x(t,t0,x0,  fj,0),  t  e  [t0,T].  (14) 
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Proof:  On  any  interval  [to,T],  the  existence  and  uniqueness  of  the  solution  is  provided  in 
Lemma  1.  We  first  wish  to  show  continuous  dependence  of  solutions  on  /t.  Let  t  e  [t0,T] 
and  define,  z(t,  n, /i0)  =  x(t,  t0,  x0,  /t)  —  x(t,  t0,  x0,  /t0),  we  have 


z(t,  fi,  Ho')  x(f,  to,  Xg,  /t)  *£(t,  to,  Xg, /lg) 


< 


'to 


'to 


f  ('b  *r  ( S ,  tg,  Xg,  /t) ,  /t)  f  (s,  X (5,  to,  Xg,  /to) ,  /to) 


ds 


f  (s i  x(s,  tg,  Xg,  /t) ,  /t)  f  x(s,  to,  Xg,  /to) ,  /t ) 


+f(s,x(s,to,xo,  Mo),  m)  ~  f(s,x(s,to,xo,Mo),Mo) 


ds 


< 


'to 


f  (*b  x(s,  t g,  Xg,  /t) ,  /t)  f  (®,  x(s,  to,  Xo,  /to) ,  /t ) 
X (5,  tg,  Xg,  /to) ,  /t)  x(<S,  tg,  Xg,  /to) ,  /^g ) 


ds 


< 


C 


'to 


x(t>,  to,  Xg,  /t )  x(s,  1  Xg,  /tg) 


ds 


+ 


'to 


y(s,  X(S,  tg,  Xg,  /tg) ,/t)  /'(SjX^Sjfg,  Xg,  /tg) ,  /tg) 


ds. 


Let  us  define  //(s,/t)  by 


d(^,/t) 


/(s,x(s,tg,  Xg,  /tg)  ,/t)  /'(s,x(s,tg,  Xg,  /tg) ,  /tg) 


and  note  that  //(s,/t)  — >  0  uniformly  in  s  as  /t  — ■>  /to  from  the  assumption  on  /  in  equation 
(11).  It  follows 


z(t,  /i,  /tg) 


< 


g(s,fj)ds 


'to 


C 


x(&,  to,  Xg,  /t)  x(s,  fg,  Xg, /tg) 


ds. 


(15) 


./to  1 

When  we  apply  Gronwall’s  inequality  and  take  the  limit  as  /t  — >•  /t0  on  both  sides  of  (15),  we 
obtain 


lim 

0 


z(t}  /t,  /tg) 


< 


lim 

0 


0, 


eC(t-to) 


and  thus 


This  completes  the  proof. 


lim  x(t,t0,x0,/t)  =  x(t,t0,x0,Mo)- 
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Lemma  3  (Mean  Value  Theorem)  Let  f  G  C[M+  x  X  x  A4,  X\  and 


(i)  If  fx(t,x,  p)  exits  and  is  continuous  for  x  G  X,  then  for  x\,x2  G  X ,  p  G  A4,  t  >  0, 
f(t,xi,n)  -  f(t,x2,n)  =  /  fx(t,sxi  +  (1  -  s)x2,At)(xi  -  x2)rfs. 

./O 

(m)  If  fn(t,  x ,  p)  exists  and  is  continuous  for  p  G  M.,  then  for  p\,  p2  G  M. ,  x  G  X,  t  >  0, 


f(t,x,ni)i-  f(t,x,ii2)  =  /  f^(t,x,  S/J.I  +  (1  -  s)/i2)(yUi  -  fi2)ds. 


Proof:  First  we  consider  (i).  Let 

G(s)  =  fit,  sx  i  +  (1  -  s)x2,  At),  0  <  s  <  1, 

and  using  the  chain  rule  of  Frechet  derivatives,  we  have 

G'(s)  =  fx(t,sx i  +  (1  -  s)x2,At)(xi  -  x2). 

Note  that  G(s)  is  well  defined  since  X  is  a  convex  space.  Integrating  G'(s )  for  s  G  (0, 1],  we 
obtain  G(l)  —  G(0)  which  is  equivalent  to  f(t,X\,jj)  —  f(t,x 2,/x)  and  hence  we  have  (i). 


The  proof  of  (ii)  is  very  similar  to  the  proof  of  (i)  and  hence  we  omit  it. 


Theorem  1  Suppose  the  function  f(t ,  x,fi)  of  (I)  has  a  continuous  Frechet  derivative  fx(t,  x,  p) 
with  respect  to  x  and  f^(t,x,p)  with  respect  to  p  with 


fx(t,x,p ) 


<M0 


and 


fn(t,x,p ) 


<  M1 


for  some  constant  M0  >  0  and  M\  >  0.  Then  the  Frechet  derivative  y(t )  =  §^x{t,  to,  xq,  p) 
exists  with  y(t )  in  B(A4,X)  and  satisfying  the  equation 


y(t )  =  fx(t,x(t,t0,x0,p),p)y(t)  +  fu,(t,x(t,t0,x0,p),p),  t>t0 

y(to)  =  0.  (16) 


Proof:  Since  fx  G  C'pR+xXx.M,  B{X,  X)],  ftl  G  C'pR+xXx.M,  B(A4,  X)],  applying  Lemma 
1,  we  find  that  the  differential  system  (16)  has  a  unique  solution  which  we  denote  by  y(t).  For 
a  fixed  p  G  M.,  p+h  G  A4,  and  t  G  [to,  T],  we  let  m(t,  p,  h)  =  x(t,  t0,  xq,  p+h)—x(t,  t0,  xq,  p). 
Then 


m(t,p,h )  =  /  {f(s,x(s,t0,x0,p  +  h),p  +  h)  -  f(s,x(s,to,x0,p),p)}ds. 


1 to 
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From  the  Frechet  differentiability  of  /  with  respect  to  x  G  X  and  p  G  Ad,  we  have 


f(t,  x(t,  to,  x0,  n  +  h),n  +  h)~  f(t,  x(t,  to,  Xo,  n),n) 

=  f(t,  x(t,  tQ,  x0,  n  +  h),n  +  h}-  f{t,  x(t,  to,  x0,  fj,  +  h),  n) 

+f(t,  x(t,  t0,  xo,  fi  +  h),  n)  -  f{t,  x(t,  t0,  x0 ,  n),n) 
=  ftl(t,x(t,tQ,x0,iJ,  +  h),n)in  +  h  -  fi)  +  Wi(h) 


<  i  \f^(s,x{s,t0,x0,g  +  h),g)  -  f^js,  x(s,  t0,  x0,  g),  g)\  \h\  ^ 


't0 


\h\ 


+ 


'to 


fx{s,  X^S,  to,  Xq ,  /l),  /i) 


|-m(s,/i,  /i)  -y(s)/i| 


\h\ 


ds 


Next  we  want  to  show 


[‘  \Mm(^,h))\ds  +  f<  \rnmds. 

I  to  \h\  Jto  \h\ 


| w2{m{t,g,h))\  <  \w2(m(t,g,h))\ 


\h\  \m(t,g,h)\ 

for  some  constant  K  >  0.  Hence,  we  want  to  look  at 


\m(t,g,h)\  = 


(s,  x(s,  t0,  x0,  g  +  h),g)h  +  Wi(h) 


't0 


+fx(s,x(s,t0,xQ,  g),  g)[m(s,  g,  h)]  +  w2(m(s,g,  h))  \ds 


< 


'to 


+ 


fli(s,x(s,t0,x0,g  +  h),g)  h  +  Wi(h) 


fx(s,x(s,t0,x0,g),g)  m(s,  g,  h)  +  w2(m(s,g,h )) 


ds. 


From  equations  (17)  and  (18),  we  obtain 


wi  (h)  =gi(t,h) 


h 


w2(m(t ,  g,  h))  =  g2(t ,  h)  m(t ,  g,  h) 


Furthermore,  with  the  assumptions  that 
bounded  by 


fx 


<  M0, 


u 


<  Mi,  the  function  \m(t,g,h)\  is 


Mi 


'to 


h 


<  /  Ml 

Jto 


+  gi(s,h) 
h 


h 


+  M0 


m(s,  g,  h )  +  ^(s,  h)  m(s,  g,  h) 


+  gi(s,h)\h\ds  +  /  (M0  +  g2(s,  h))  \m(s,  g,  h) 
Jt0 


ds 

ds. 


Again,  applying  Gronwall’s  inequality,  we  obtain 


m(t,  g,  h ) 


<  K 


h 
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where  K  =  +  gi(s,h)}ds)e^toMo+92('s,h^ds  where  gi(s,h)  and  g2(s,h)  converge  to  0 

uniformly  in  s  as  \h\  — >  0.  It  follows 

\w2(m(t,fi,h))\  <  \w2(m(t,fi,h))\ 

\h\  ~  \m(t,n,h)\ 


Hence, 

| m(t,fi,h)  -  y(t)h\ 
\h\ 


<  !  \f^s,x(s,t0,x0lfi  +  h),n)  -  /M(g,x(g,f o,x0,fj,),fj,)  \  \h\ 


'to 


\h\ 


+  f  Mjm{s’^h)-Vis)h\ds 

Jt0 


\h\ 


+  ds+  f  MM*. 

Jto  \m{s,n,h)  |  Jt0  \h\ 

Since  x(t,  t0,  x0,  g)  is  continuously  dependent  on  y  from  Lemma  2,  we  have 


lim 

W-0 


fp{t,x(t,t0,x0,(ji  +  h),n )  -  /M(t,  t0,  ^o,  A*),  A*) 


=  0, 


which  implies 


ffl(t,x(t,t0,x0,n  +  h),n )  -  o,xo,fj),(j)  <  g3(t,h ) 


where  g3(t,h)  — >  0  as  \h\  — ■>  0.  In  addition,  we  apply  the  inequalities  in  equations  (17)  and 
(18),  and  thus  obtain 


I m(t,fi,h)  -y(t)h\ 

\h\ 


< 


Mn 


'to 


I h )  -y(s)h\ 

\h\ 


ds 


(19) 


+  /  {0i (s,  h)  +  Kg2(s,  h )  +  g3(s,  h)}  ds. 


't0 


Hence,  using  Gronwall’s  inequality  and  taking  the  limit  of  (19)  as  \h\  — >  0,  we  have 
I m{t,n,  h )  -y{t)h\ 


lim 

|fc|— o 


\h] 


<  lim 


{0i(s,  h )  +  Kg2(s,  h )  +  ^(s,  h)}  ds\eMo(t  to) 


to 


=  0, 


(20) 


which  completes  the  proof. 
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Remark:  Although  in  this  manuscript  we  consider,  for  ease  in  exposition,  a  strong  as¬ 
sumption  of  global  Lipschitz  on  /,  we  can  also  readily  establish  similar  results  for  the  case 
of  weaker  assumptions  involving  local  Lipschitz  conditions  on  /  plus  domination  of  /  by  an 
affine  function.  Details  of  this  approach  can  be  found  in  Lemma  2.1  in  [2],  Many  systems 
of  interest  in  applications  (including  the  example  of  [4],  [5]  described  below)  satisfy  these 
weaker  assumptions. 

3  A  Special  Case 

In  this  section,  we  consider  a  special  case  of  equation  (1)  where  the  parameter  of  interest 
is  an  element  in  a  convex  subset  of  Xi.  This  allows  us  to  extend  the  results  given  in  [3] 
to  provide  sensitivity  equations  for  probability  density  dependent  systems.  First,  we  define 
p  G  Xi  =  L2(Q )  and  x  G  X  where  Q  =  [— r,  0]  and  X  =  M4  x  L2(— r,  0;M4).  Then  for 
x(t )  =  (v(t),vt)  we  consider  a  system  (1)  with  the  right  side  of  the  form 

f(t,x(t),p)  =  F(t,v(t))  +  [  v(t  +  r)p(r)dr,  (21) 

JQ 

where  vt  denotes  the  function  r  — >  v(t  +  r),  r  G  [— r,  0].  For  each  x  =  (77,  0)  €  X  we  define 
g(x,p )  =  Jq  <f>(t  +  r)p(r)  dr.  Then  g(x,p )  is  Frechet  differentiable  on  Xi  =  L2(Q )  and  we 
have  g'(x,p)p  =  g(x,p).  Due  to  our  particular  interest,  we  restrict  the  parameter  space  to 
the  sets  of  probability  density  functions  in  L2(Q )  and  define 

Mc  =  {p  G  L2(Q )  |  p  >  0  and  f  p(r)  dr  =  1}. 

Jq 

Since  M.c  is  a  convex  subset  of  Ad  =  L2(Q),  we  may  differentiate  g  with  respect  to  p  using 
the  directional  derivative  for  p,  q  E  Xic.  We  find  that  g  is  differentiable  with  respect  to  p  in 
the  direction  of  (q  —  p)  with 


g‘(x,p)(q  -  p)  =  g(x,q  -  p).  (22) 

Obviously,  equation  (22)  implies  the  directional  derivative  of  g  is  the  Frechet  derivative  on 
Xi  restricted  to  q—p  where  p,  q  G  Xic.  It  follows  that  for  the  equation  (1)  with  the  right  side 
defined  in  (21)  for  p  e  Xic,  the  corresponding  sensitivity  function  satisfies  the  sensitivity 
equation  (16)  of  Section  2. 


4  Approximations  and  Numerical  Results 

To  apply  the  theoretical  results  of  Section  2  to  a  specific  system  of  interest,  we  first  derive  and 
approximate  the  sensitivity  equation  of  an  HIV  model  that  has  the  structure  of  the  special 
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case  presented  in  Section  3.  We  consider  an  HIV  model  of  distributed  delay  differential 
equations  derived  and  investigated  by  Banks,  et  ah,  in  [4],  [5] 


V(t) 

Mt) 

c(t) 


-cV(t)  +  ncC(t)  -  aV(t)T(t)  +  r)A  f  A(t  +  r)pi(r)dr 


(rv  -  8A)A(t)  —  8Y(t)A(t)  +  aV(t)T(t);i*~  7  f  A(t  +  T)p2(r)dr 


Sc)C(t)  -  8Y(t)C(t)  +7  f  A(t  +  r)p2{r)dT 


(23) 


Tit)  =  (ru-8u)T(t)*8Y(t)T(t)-aV(t)T(t)  +  S,  for  t  >  0, 

where  Y(t)  =  A(t)  +  C(t)  +  T(t).  All  the  parameters  and  compartments  are  defined  and 
described  in  Table  1  and  Table  2  below.  Here  p\  and  p2  are  probability  density  functions 
for  the  time  delay  iq  and  t2,  respectively,  where  77  <  0  represents  the  time  delay  between 
acute  infection  and  viral  production  and  r2  <  0  denotes  the  delay  between  acute  infectivity 
and  chronic  infectivity  such  that  — r  <  7y  +  r2  <  0.  We  employ  v  =  [ V. ,  A,  C,  T]T  and  x(t)  = 
(v(t),vt)  G  X  =  M4  x  L2(— r,  0;M4).  We  let  the  parameter  space  M  =  L2(— r,  0)  x  L2(— r,  0) 
and  Mc  =  {(pi,p2)  G  AT  |pi,  p2  >  0  and  J°_rPi{r)dT  =  /°rp2('r)dr  =  1}.  Then  the  HIV 
system  (23)  can  be  rewritten  as  an  abstract  Cauchy  problem 

x(t)  =  Ax(t)  +  /2(t),  t  >  0 

®(0)  =  x0,  (24) 

where  r  >  0  is  finite,  f2{t)  =  ([0,  0,  0,  S]T ,  0)  G  X,  and  x0  =  (77,  (ft)  G  A".  Here  A  is  a  nonlinear 
operator  such  that  A  :  T>(A)  C  X  — ■>  X  and  ^4.(77,  (ft)  =  (ft)  +  j\  (r/),  ^0^  where  X>(4)  = 

{(77,  (ft)  e  X\(ft  e  H1(—r,  0;  M4)  and  77  =  0(0)}.  Furthermore,  for  (77,  (ft)  G  M4  x  L2(— r,  0;  M4), 


L(rj,  (ft)  = 


—c  0  nc  0 

0  rv  —  8a  0  0 

0  0  rv  —  8c  0 

0  0  0  r„  —  8n, 


77  +  nA [5(i, 2)] (4, 4)  /  <ft{r)p\{r)dr 


+7(^(3, 2)] (4,4)  -  [5(2,2)] (4,4))  /  0(r)p2(r)dr, 


/l(h) 


-arurp 

“5(Ei=2  Vi)V2  +  <Wl774 
-^(Et2  Vi)V3 

~S(Ylt=2Vi)V4  -  077  1  774 


where  [%j)](4,4)  is  a  4  x  4  matrix  with  a  one  in  the  (7,  j)th  component  and  zeros  everywhere 
else.  In  [4],  [5]  the  mass  action  product  nonlinearities  in  f\  are  replaced  by  saturating 
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nonlinear  functions  -  see  the  definition  of  /,  in  [4],  [5].  The  resulting  model  then  satisfies 
the  required  conditions  of  the  theory  in  Section  2. 

We  consider  here  the  sensitivity  of  the  system  (23)  with  respect  to  p\ .  Similar  ideas  and 
calculations  can  be  pursued  for  sensitivity  with  respect  to  p2  or  to  the  pair  (pi,p2)  G  M.c. 
For  y  =  [J^,  J^j-,  J^j-,  f^-]T,  we  hnd  that  the  sensitivity  equation  of  the  HIV  system  (23)  with 
respect  to  p\  is  the  solution  of 


y(t\x,Pi)  =  Jv(y(t))y(t-,x,p1)+ g^v^px),  t>  0 

y(  0)  =  0, 

where  x(t)  =  (v(t),vt\ 


J V  - 


and 


— c  —  aT  0  nc 

aT  rv-SA-  5(2 A  +  C  +  T)  -5 A 

0  -SC  rv- Sc-  S(A  +  2C  +  T) 

-aT  -ST  -ST  ru  -  Su 


nA  f°r  A(t  +  t)p\{t)(It 
0 
0 
0 


(25) 


—aV 

-SA  +  aV 
-SC 

S{A  +  C  +  2T)-aV 


In  order  to  solve  the  sensitivity  equation,  we  obviously  need  the  solution  x  of  system  (24).  Since 
we  cannot  compute  the  exact  solution  x  of  (24),  we  approximate  x  by  xN  using  the  linear  spline 
approximation  scheme  for  delay  differential  equations  developed  by  Banks  and  Kappel  in  [8].  We 
employ  {XN ,  PN ,  to  be  the  approximating  scheme  where  XN  is  the  spline  subspace  of  X, 

PN  is  the  orthogonal  projection  of  X  onto  XN ,  and  AN  is  the  approximating  operator  of  A  such 
that  =  PN  AP^ .  Thus,  the  approximation  to  system  (24)  is  described  by 


xN{t)  =  ANxN{t)  +  PNf2{t),  t>0 

xN(0)  =  PNx  0.  (26) 


As  shown  in  [5],  [8],  the  approximating  scheme,  {XN ,  PN ,  A^},  yields  solutions  such  that  xN(t)  — > 
x(t)  uniformly  in  t  on  a  finite  interval,  as  N  — >  oo  and  fixed  (p\ ,  p2)  G  Mc-  In  order  to  apply  the 
linear  spline  approximation  scheme,  we  fix  the  basis  for  a  subspace  X±  of  XN  to  be  the  piece- 
wise  linear  splines.  Before  we  construct  the  splines,  we  partition  [— r,  0]  by  =  — i(r/N )  for 
i  =  0,1,...,  AT  and  then  define  the  splines  /3N  =  (/3N(0),  (3N),  where  /3N  =  (eff,  , ...,  ejy)  0  In. 
Here  In  denotes  the  n  x  n  matrix  and  the  piecewise  linear  e^’s  are  defined  by 

ef  {tf )  =  $ij  for  i,j  =  0,1, ..,  N . 


When  we  restrict  AN  to  XjV  we  have  a  matrix  representation  of  AN ,  which  we  denote  as  A±  . 
Furthermore,  we  define  wN(t )  and  FN(t )  to  be  xN(t)  =  /3NwN(t )  and  PN f2{t)  =  /3NFN(t ), 
respectively.  It  follows  that  solving  for  xN(t )  in  system  (26)  is  equivalent  to  solving  for  wN(t )  in 
the  nonlinear  ordinary  differential  equation 


wN(t)  =  A?wN(t)  +  FN(t),  t>  0 

wN(  0)  =  w£,  (27) 
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where  /3Nwf  =  PNx o-  When  wN  are  thus  obtained,  Theorem  3.2  in  [8]  combined  with  the  results 
from  [2]  guarantees  that  the  product  (3NwN  converge  uniformly  in  t  on  a  finite  interval  to  xN ,  the 
solution  of  system  (26).  We  have  only  briefly  summarized  the  linear  spline  approximation  scheme 
here;  for  more  details  on  the  proof  of  the  results  and  how  to  compute  Af ,  PNx o,  and  PN  f2,  see 
[5]  and  [8]. 

When  we  apply  the  linear  spline  approximation  scheme  to  our  HIV  system,  we  establish  a  4(1V+ 
1)  dimensional  nonlinear  ordinary  differential  equation  system.  The  solution  of  the  constructed 
system,  wN ,  is  for  the  generalized  Fourier  coefficients  when  we  expand  the  solution  x  in  terms  of 
(IV  +  1)  piecewise  linear  spline  basis  elements.  For  our  simulations,  we  consider  xo  =  (u(0),u(r)) 
where 

v(0)  =  [0,1.5  x  106, 0,1.35  x  106]T, 

and  v(r)  =  0  for  t  G  [— r,  0).  The  values  of  the  parameters  we  use  are  listed  in  Table  1.  The 
functions  p\  and  p2  are  modified  Gaussian  probability  density  functions  with  means  t\  =  —22.8 
and  72  =  —26,  respectively,  each  with  variance  1.  Due  to  the  nature  of  our  problem  where  we  only 
consider  p\  and  p2  for  r  G  [— r,  0],  we  actually  use  normalized  truncated  Gaussian  density  functions 
in  our  computations.  That  is,  we  have 

Pi(r)  =  — i=e  W~  for  i  =  1,2,  (28) 

a  V  (2?r) 

where  r\  =  —22.8,  T2  =  —26,  and  a  =  1.  Further,  we  normalize  the  pi  so  that  J°rpj(r)dr  =  1;  i.e. , 

we  divide  pi  by  d  where  d  =  f°_rPi{T)dr.  Applying  the  Banks/Kappel  linear  spline  approximation 
scheme  and  the  corresponding  theoretical  arguments  to  the  system  described  above  with  fixed  p\ 
and  p2,  one  can  obtain  that  v N  =  [VN ,  An ,  CN ,Tn]t  converges  as  N  — >  oo.  This  convergence  is 
illustrated  computationally  in  Figure  1  for  the  fixed  p\  and  p2  given  above.  We  note  that  these 
solutions  require  quadratures  on  the  integral  terms  involving  the  p\  and  p2-  We  used  the  Runge- 
Kutta  method  in  MATLAB’s  ODE23  for  solution  of  our  approximate  ordinary  differential  equations 
(27)  and  (29)  below. 

Since  we  only  have  xN ,  the  approximations  of  x ,  we  must  approximate  the  solutions  of  the 
sensitivity  equation  (25).  Moreover,  it  is  of  interest  to  further  approximate  the  densities  p±  in  the 
functionals  g\  with  finite  dimensional  parameterized  densities  pfr .  (This  type  of  approach  is  useful 
in  inverse  problems  when  one  must  estimate  the  densities.)  In  this  case,  we  desire  convergence  of 
solutions  yN'M ,  the  solution  of  (25)  with  approximations  xN  and  pf1  in  place  of  x  and  pi,  to  y. 
To  illustrate  with  an  example,  we  define  p^{r)  =  af^iW(r)>  such  that  pf1  — >  pi,  where  the 

if1' s  are  the  usual  piecewise  linear  splines  (see  for  example  [9]).  We  enforce  the  probability  density 
constraints  pfr  >  0  and  f°r  J2?=i  of1  if1 \T)dT  =  1.  It  is  obvious  that  when  xN  — >  x  and  pff  — >  p\ , 
we  have  Jv{vN)  — ►  Jv(v)  and  g\{t\  vf  ^pf1)  — >  gifavt^pi)  as  N,M  —>  oo.  Therefore,  the  sensitivity 
function  y  can  be  approximated  by  the  solution  of 

yN’M(t)  =  Jv(vN(t))yN’M(t)  +  g?'M(t)  t  >  0, 

yNM(  0)  =  0,  (29) 
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Parameters 

Values 

Description 

c 

0.12 

infectious  viral  clearance  rate 

nA 

0.1194 

infectious  viral  production  rate  for  acutely  infected  cells 

nc 

1.6644  x  10“6 

infectious  viral  production  rate  for  chronically  infected  cells 

7 

8.7625  x  10“4 

rate  at  which  acutely  infected  cells  become  chronically  infected 

rv 

0.035 

birth-rate  for  virus  infected  cells 

ru 

0.035 

birth-rate  for  uninfected  cells 

5a 

0.0775 

death-rate  for  acutely  infected  cells 

<5c 

0.0257 

death-rate  for  chronically  infected  cells 

K 

0.0160 

death-rate  for  uninfected  cells 

5 

5.4495  x  10-13 

density  dependent  overall  cell  death-rate 

a 

1.3359  x  10“6 

probability  of  infection 

S 

0.0 

constant  rate  of  target  cell  replacement 

Table  1:  Definition  and  values  of  in  vitro  model  parameters 


Notations 

Description 

V 

infectious  viral  population 

A 

acutely  infected  cells 

C 

chronically  infected  cells 

T 

uninfected  or  target  cells 

Y 

total  cell  population  (infected  and  uninfected) 

Table  2:  Definition  of  in  vitro  model  compartments 


where 


nA  f°r  AN(t  +  t)p¥(t)  dr  ' 
0 
0 
0 


Using  standard  arguments  with  the  convergence  xN  x,  pf1  —>  pi,  one  can  readily  establish  that 
yN’M  — >  y  as  N .  M  — >  oo.  Similar  convergence  arguments  can  be  made  for  the  solutions  xN,M  of 
the  system  (26)  with  the  pi  s  approximated  by  pf1' s.  We  note  that  this  is  precisely  the  type  of 
convergence  results  required  to  establish  method  stability  in  inverse  problems  see  [9],  [15]. 

To  illustrate  our  statement  on  convergence  of  yN'M ,  we  first  fix  N  =  32  and  solve  equation  (29) 
for  different  values  of  M.  As  graphed  in  Figure  2,  we  have  yN’M  converges  for  a  fixed  N  =  32  as 
M  — >  oo.  Next  we  fix  M  =  256  and  solve  equation  (29)  for  different  values  of  N.  We  depict  the 
solution  yN-M  for  M  =  256  and  different  values  of  N  in  Figure  3  where  it  is  evident  that  yN’M 
converges  for  M  =  256  and  N  oo. 
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gure  1:  Simulations  of  vN  where  the  thick  solid  line  corresponds  to  N  —  16, - represents 

=  32,  represents  N  =  64,  .  represents  N  =  128,  and  the  thin  solid  line  is  for 


=  256 


16 


x  10 


Virions  V 


Acutely  Infected  Cells  A 


x  io“3  Chronically  Infected  Cells  C 


Uninfected  Target  Cells  T 


Figure  2:  Simulations  of  yN’M  for  a  fixed  N  —  32  where  represents  M  =  50, 

represents  M  =  100, - corresponds  to  M  —  200,  and  the  solid  line  represents  M  =  400 
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Figure  3:  Simulations  of  yN>M  for  a  fixed  M  =  256  where  .  represents  N  =  32, 

represents  N  =  64, - corresponds  to  N  —  128,  and  the  solid  line  is  for  N  =  256 
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5  Concluding  Remarks 

In  this  paper  we  have  given  a  general  theoretical  sensitivity  framework  for  abstract  systems  in  a 
Banach  space  with  dynamics  that  depend  on  vector  (Banach)  space  parameters.  We  then  show  that 
this  includes  a  sensitivity  theory  for  systems  that  depend  on  probability  densities  wherein  a  natural 
space  for  the  parameters  is  M  =  L2 .  We  also  demonstrated  how  one  could  treat  theoretically  and 
computationally  examples  with  distributed  delays  in  the  context  of  this  framework.  The  example  we 
presented  illustrates  the  connection  between  the  efforts  here  and  those  in  [3]  where  parameterized 
distributions  are  considered.  In  some  sense,  one  can  consider  our  present  efforts  as  an  infinite 
dimensional  extension  of  standard  sensitivity  theories  for  finite  dimensional  vector  parameters. 

Our  current  theory  readily  accommodates  measures  that  are  absolutely  continuous  with  respect 
to  Lebesgue  measure  (i.e.,  measures  with  a  probability  density).  An  important  generalization  of  our 
efforts  would  allow  treatment  of  measures  with  an  absolutely  continuous  component  and  a  saltus 
component  of  the  form 


or 


k 

P(T)  =  ^Pi^nir)  + 
1=1 


k 

dP(T)  =  Y,  Pi8Ti{r)dT  +  p(r)dT, 
1=1 


where  Ar  is  the  Dirac  measure  with  atom  or  mass  at  r.  We  are  currently  pursuing  such  a  theory 
in  which  the  parameter  space  is  no  longer  a  Banach  space,  but  rather  a  metric  space  that  is  based 
on  a  combination  of  the  Prohorov  metric  topology  (see  [6])  and  the  L 2  topology  (or  possibly  the 
weak  L2  topology  for  compatibility  with  the  Prohorov  nretric-see  [14]). 
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